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Abstract 

We make a trivial modification to the elegant analysis of Garg and 
Khandekar (Gradient Descent with Sparsification ICML 2009) that 
replaces the standard Restricted Isometry Property (RIP), with an- 
other RIP-type property (which could be simpler than the RIP, but we 
am not sure; it could be as hard as the RIP to check, thereby rendering 
this little writeup totally worthless). 


The proof is a super-trivial modification to the proof of GK, and 
goes through if one replaces (1 + 52s) by 132s, and (1 — 52s) by oi2s'. 
Thus, we omit further details to avoid verbosity. The interested reader 
ca n check this fact in a few min utes herself by checking the nice paper 
of iGarg and Khandekad [2009ll . 

The only point we wish to stress is that the RIP in its original form 
is not critical to GK's proof, but rather just an RIP-type inequality of 
the form l|4ll. 
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min f{x) = \\y — (^x 

which iteratively updates x as 

x^Hs{x~ 0.57"' V/(a;)) 

where Hs denotes the hard-thresholding operator which sets all but 
th e s largest (in magnitu de) entries to zero. The most important part 
of iGarg and Khan dekar's paper is the elegant analysis which estab- 
lishes that under the restriction 52a < 1/3 on the RIP constant of the 
matrix $, updating x as per ^ solves (TJ in nea r-linear t ime. 

The Restricted Isometry Property or RIP (see ICandesll2008ll for a 
survey) provides sufficient conditions for sparse recovery. In particu- 
lar, define the isometry constant of $ as the smallest number 5s such 
that for all s-sparse signals x G R" 


{l~5s)\\xf < \\(i>xf < il + 5s)\\x\[ 


(3) 


where ||-|| denotes the standard £2, i.e., Euclidean norm. Under 
various restrictions on 52s di fferent recovery guarantees have been 
provided — see ICande^ l2008ll for example. 

One can replace (O by the potentially simpler property (or maybe 
verifying this property is also as difficult as verifying the RIP). Let 
Qfs > and /3s be some numbers for which, for every s-sparse signal 
X, the following version of the RIP holds, 

as\\xf <\\<i>xf <f3s\\xf. (4) 

Then, the elegant analysis of iGarg and Khandekad l2009ll (hereafter 
abbreviated as GK) can be trivially changed to still hold for (|4j. The- 
orem 1 shows the noise-free case; a similar theorem for the noisy 
version can also be derived, but is skipped for brevity. 

Theorem 1 (Sparse recovery). Let ^ be a measurement matrix for 
which /32s < 2a2s and let x* he an s-sparse vector satisfying y = 
<^x*. Then the GraDes algorithm ofGK with 7 = /32s, computes an 
s-sparse vector x £ R" such that f{x) < e in 


iog(lly|PA) ' 

loga2s/(/32s — 02s) 


(5) 
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